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Abstract 

Determining the relative importance of nodes in directed networks is important in, for example, 
ranking websites, publications, and sports teams, and for understanding signal flows in systems biol- 
ogy. A prevailing centrality measure in this respect is the PageRank. In this work, we focus on another 
class of centrality derived from the Laplacian of the network. We extend the Laplacian-based cen- 
trality, which has mainly been applied to strongly connected networks, to the case of general directed 
networks such that we can quantitatively compare arbitrary nodes. Toward this end, we adopt the idea 
used in the PageRank to introduce global connectivity between all the pairs of nodes with a certain 
strength. Numerical simulations are carried out on some networks. We also offer interpretations of the 
Laplacian-based centrality for general directed networks in terms of various dynamical and structural 
properties of networks. Importantly, the Laplacian-based centrality defined as the stationary density 
of the continuous-time random walk with random jumps is shown to be equivalent to the absorption 
probability of the random walk with sinks at each node but without random jumps. Similarly, the 
proposed centrality represents the importance of nodes in dynamics on the original network supplied 
with sinks but not with random jumps. 
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I. INTRODUCTION 



A network is a set of nodes and a set of links that connect pairs of nodes (see [l ^1 for reviews). 
In applications including information science, sociology, and biology, it is often necessary to 
determine important nodes in a network. Various definitions of the importance of nodes, 
or centrality measures, have been proposed since the first classical studies on social network 
analysis in the 1950s [J HE]. 

It is often more suitable to consider links to be directed, where the direction of link represents 
relationships such as the control of one node over another, unidirectional flow, and citation. 
Many centrality measures including degree centrality, betweenness centrality, and eigenvector 
centrality can be adopted to the case of directed networks. Nevertheless, the most popular 
centrality for directed networks appears to be PageRank, which takes nontrivial values only in 
directed networks. It was originally developed for ranking websites 6|. In other words, the 
PageRank of a node is large when the node receives many links from important nodes that do 
not have too many outgoing links. 

In the present study, we focus on another important class of centrality for directed networks, 
i.e., those derived from the Laplacian of the network. This class of centrality has a long history 
[7 -12 1 and is mathematically close to the PageRank (see Sec. E}. Furthermore, for strongly 



connected networks, i.e., networks in which there exists a path of directed links between an 
arbitrary ordered pair of nodes, the Laplacian-based centrality value of a node, which we also 



call the influence of a node, represents its importance in various dynamics on networks 13Ml5|. 



The Laplacian- 



networks 
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Dased centrality measure has mostly been analyzed for strongly connected 



151 ] . However, real directed networks may not be strongly connected. This 



is typically the case when the network is sparse (i.e., number of links is relatively small) or of 
small size. Although the Laplacian-based centrality in the original form is applicable when all 
the nodes are reached along directed paths from a certain specified node, such a network is not 



generic, 
networks 



he Laplacian-based centrality has been generalized to the case of general directed 



10h12|. In the generalized version, nodes in an uppermost component have positive 



centrality values, whereas nodes in a downstream component have zero centrality values (see 
Sees. HTl and HTT1 for definitions of uppermost and downstream components). However, we may 
want to compare the importance of nodes in downstream components. We may also wish to 
compare a node 1 in an uppermost component and a node 2 in a downstream component that 
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is not under the control of node 1. 

In this paper, we extend the Laplacian-based centrality measure (i.e., influence) to the case 
of general directed networks. Networks do not have to be strongly connected and can be com- 
posed of disconnected components. The extended centrality measure, called as the influence 
or extended influence without ambiguity, is a one- par ameter family of the centrality measure 
with parameter q such that the previous definition 10Ml2| is recovered in the limit q — > 0. The 
extended influence is a relative of the PageRank; the influence and the PageRank correspond 
to continuous-time and discrete-time simple random walks, respectively. The present paper is 
organized as follows. In Sees. [Ill and we review previous works on the influence for strongly 
connected and general directed networks, respectively. In Sec. \1V\ we present new interpreta- 
tions of the centrality measure introduced in Sec. IIII1 In Sec. [V] we extend the concept of the 
influence by borrowing the idea used in the PageRank to introduce some global connectivity 
to the original network. We also show that the proposed influence can be interpreted as the 
dynamical properties of nodes on the original network without additional global connectivity. 
In Sees. I VI I and IVIfl we apply the influence to toy examples and relatively large networks, 
respectively. In Sec. IVIIfl we summarize and discuss our results, with an emphasis on the 
comparison of the influence and the PageRank. 

II. INFLUENCE FOR NETWORKS WITH SINGLE ZERO LAPLACIAN EIGEN- 
VALUE 

Consider a directed and weighted network having N nodes. The weight of the link from 
node i to node j is denoted by and assumed to be nonnegative. Wij > represents the 
strength with which node i governs node j. and Wji are generally different from each other. 

The Laplacian-based centrality measure, called the influence of node i and denoted as Vi, is 
defined as the solution of the following set of iV linear equations: 

«i = t^ 1 1 , (l<i<N). (1) 

The normalization is given by YliLi v i = 1- We can rewrite Eq. (JT|) as 

(«!••• v N )L = 0, (2) 
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where L = (Ly) is the asymmetric Laplacian defined by 



Lij 



(1 - S^Wji 



(3) 



Vi represents the importance of nodes in various dynamics on networks, such as the voter model, 
a random walk, DeGroot's model of consensus formation, and the response of synchronized 
networks [13I ] . 

If a network is strongly connected, that is, if any node j can be reached from an arbitrary 
node i along directed links, the Perron- Frobenius theorem guarantees that (v\ ■ ■ ■ vn) is unique 
and Vi > (1 < i < N). In particular, for undirected networks, which are strongly connected as 
long as they are connected, we have = 1/N. Therefore, the influence is a centrality measure 
that is relevant only in directed networks. 

To discuss the uniqueness of the zero eigenvector (v± ■ ■ ■ vn) of L, we use the concept of 
the root node loj ]. Consider the set G T of m nodes in a given network (1 < m < N). We 
define G r to be a set of root nodes if an arbitrary node can be reached along directed links 
from a node included in G T and G T is minimal. In the example shown in Fig. [TJ {1,2} qualifies 
as G r . {1,3} is another example of G r . {1,4,5} does not qualify because it is not minimal. 
The minimality indicates that some nodes cannot be reached from G' T , where G' r is the set of 
nodes with m—1 nodes defined by removing an arbitrary node from G r . For strongly connected 
networks (m = 1), G r can be a set of any single node. As this exercise suggests, G r for a given 



network is generally not unique. However, m is uniquely determined from a network [10] . The 
directed chain shown in Fig. [2] is a network that is not strongly connected with m = 1. In 
Fig. 121 we obtain V\ = 1 for the unique root node 1 and Vi = (2 < i < N). 



The mu 
eigenvalue 



tipl 



16 



icity of the zero ei 



genvalue of L, also called the geometric multiplicity of the 



17| . is equal to m 
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19j . Therefore, the influence given by Eq. ()2]) is well 



defined only for networks with m — 1, and most previous papers that treat Eq. ()2]) concentrate 



on strongly connected networks 



E-9 
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2 Oj ]. In this case, (v± 



vn) can be readily 



calculated by the power iteration or the enumeration of the directed spanning tree [13|, |l4j . 



III. CASE OF MULTIPLE ZERO LAPLACIAN EIGENVALUES 

In this section, we treat networks with multiple zero Laplacian eigenvalues. Such a network 
is not strongly connected. The influence explained in Sec. [Ill was extended to accommodate 
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this case by Agaev-Chebotarev [lOj, LLl| and Borm et al. [12| . We develop a new centrality 



measure in Sec. |V] by generalizing their definitions. In this section, we explain their centrality 
measure and examine its properties. 

Consider a continuous-time simple random walk on the network generated by reversing the 
direction of all the links of the original network. We select each node i (1 < i < N) as the 
initial location of the random walker with probability 1/iV ". 
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or directed networ 



£S that are 



ll| and Borm et al. 



12j defined 



not necessarily strongly connected, Agaev-Chebotarev 
a centrality measure, which we call the influence and denote by Vi without ambiguity, as the 
long-term probability that the walker visits node i. For a strongly connected network, Vi is 
equal to the stationary density of the random walk and coincides with Vi defined by Eq. fl2]) 
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20|. For a network with a single root node zq, node io is the unique absorbing boundary, 
and any random walker is eventually trapped at node iq. Therefore, v io = 1 and Vi — (i ^ iq), 



which is again consistent with Eq. ([2]) [13]. 



Because the generator of the continuous-time random walk is equal to — L, we obtain 

Oi • • • v N ) = lim — (1 • • • 1) exp(-Lt). 

i->oo iV 



The spectral decomposition of L yields 



-u 



E 

m'=l 



w (oyo) 



U 



(A 2 )„, (A 2 ) 



V 



(4) 



(5) 



where v^j and u^', (1 < vnl < m) are the zero left and right eigenvectors of L, respectively. 
Without loss of generality, we assume that v^, and w^, are normalized and orthogonalized 
such that 



,(°) 



N 

E 

i=i 



; (0) 
m',j 



and 



u mi u, m 2 



1 < m! < m) 



(6) 



J m 1 m,2- (7) 

A2 is the spectral gap (i.e., smallest positive eigenvalue) of L. u[ X2 ^ and v[ X2 ^ are a pair of left 
and right eigenvalues of L corresponding to A2, where v[ X2 ^ ^ 0. Other modes that decay 
at least as fast as e _A2 * with t are omitted in Eq. Note that Eq. §5§ is also valid when L 
is not diagonalizable and has a nondiagonal Jordan normal form. The combination of Eqs. (jlj) 
and ([5]) leads to 



VNj 



N 



DE 



(0) (0) 



(0) 



When m — 1, by substituting u\ 
obtain (v\ ■■■ v^) = v± . Therefore, Eq. 



1) T (T denotes the transpose) into Eq. (jSJ), we 
extends Eq. §2$). We note that Eq. (E]) is also 
applicable to disconnected networks for which m > 2. 

To gain insights into Eq. (jHJ), we consider the decomposition of directed networks into 
strongly connected components (SCCs). We define the uppermost SCC as an SCC that is 
not downstream to any other SCC along directed links. The number of uppermost SCCs in a 



given network is equal to m [10j. The choice of G r , the set of root nodes, is unique up to the 
arbitrariness of the choice of a node in each uppermost SCC. This is consistent with the fact 
that the set of any single node is qualified as G r in a strongly connected network. 



In general, we can permute the indices of the nodes such that L is the irreducible normal 



form 



scner, 

m 



given by 











L>21 


L22 





L31 


L32 


£33 



V 








Lbb 



(9) 



Lbi Lb2 

The diagonal block Lyy (1 < b' < b) corresponds to the b'th SCC. We denote the number of 
nodes in the fe'th SCC by Ny. Then, Lyy' is an Ny x Nyi matrix and X^/=i — N. The 
lower triangular nature of Eq. (Q implies that the SCCs are ordered in Eq. ([9]) such that links 
may exist from a node in the 6'th SCC to the b"th SCC only when b' < b" . 

Because m out of b SCCs do not receive links from other SCCs, the uppermost SCCs occupy 
the first m rows of blocks in Eq. (151), and we obtain 



0, (mi > m 2 , 1 < mi < m) 



(10) 



Equation Q constrained by Eq. fllOp is called the Frobenius normal form 2l|, p. 38]. In 
addition, L m / m i (1 < m' < m) is the Laplacian matrix of the m'th SCC, which has a single zero 
eigenvalue. The eigenequations for this submatrix are represented by 

= 0, {v m > 1 ■ ■ ■ v m > >N )L m r m > = 0. (11) 



V) 
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It is easy lOj to verify that the m left zero eigenvectors of L are given by 



A'., 



v m' = ( Vm '^ Vm '< 2 ' ' ' Vm '> N m i Q—jJl )' ^2 v m',j = 1) (1 < m' < m). (12) 



JVi+...+JV m ,_ 1 
zeros 



N m > +1 +...+N b J=l 
zeros 

.(°)„.(°) _ x n „A ±u„ y\r , m ™„f r».(°) 



To satisfy the normalization condition v mi u m [ = <5 mi) m 2 and the first Ylm'=i rows °f Lu m , 
0, we should take 



u 



(o) 



.0 • • • 0. 1 



1. .0 



TCt lT 



u b Z) T , 



(13) 



A r i + ...+Af m /_ 1 JV m / ones iV m , +1 +...+Ar m 
zeros zeros 



where u^, (m + 1 < b' < b) is the iV;/- dimensional column vector determined by 



/ T \ /A 



/ 



V 



Lb,m' 



J 



+ 



L m +l,m+l 
L m +2,m+l L m+ 2,m+2 



\ 



J b,m+l 



J b,m+2 







Lbb 



\ 



0. 



(14) 



To show that Eq. (1T41) has a unique nonnegative solution, we decompose the diagonal block 
L m ' m > (m + 1 < m' < N) as 

L m 'm' — L m r m i + D m i, (15) 

where L m i m > is the Laplacian of the m'th SCC and D m > is the diagonal matrix whose ith 
element is equal to the total number of incoming links from SCCs 1, . . ., m! — 1 to the ith 
node in the m'th SCC. Equation (fT5"j) implies that L m > m i is diagonally dominant. Therefore, 
by applying the Jacobi or Gauss-Seidel iteration to the first N m +^ rows of Eq. (jl4j) . we can 



uniquely calculate u^t 1 16[. Furthermore, L m i m > is an M- matrix 22j. Because all the elements 
of L m+ i >m /(l ■ ■ ■ 1) T that appear in the first N m+ i rows of Eq. (TT4"j) are not positive, all the 
elements of are guaranteed to be nonnegative 22j, p. 136]. By substituting the obtained 

u™^ 1 in Eq. (fT4"j) and applying the Jacobi or Gauss-Seidel iteration to the next A^ m+2 rows, we 
can uniquely determine w™, +2 . By repeating the same procedure, we can successively determine 
u^,i whose elements are unique and nonnegative. 
The projection of L onto the eigenspaces yields 



(16) 



^m'=l 
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where I is the N x N unit matrix. Note that Eq. ( II 6p is valid even if L is not diagonalizable. 
By multiplying the ^-dimensional column vector (1 • ■ ■ 1) T , a zero right eigenvector of L, from 
the right to both sides of Eq. ffT6]) and using Eqs. flOJ) and (JZJ), we obtain 



E 

m'=l 



(0) 



(17) 



(0) 
m',j 



1 (1 < J < iV), where u^, ■ is the jth element of u^j and 



(o) 



m',j 



Equation (|T7|) implies Xw=i 
represents the probability that the random walk starting from node j is trapped by the m'th 
uppermost SCC. ■ can be interpreted as the magnitude of the influence that the m'th SCC 
exerts on node j. Note that u^, ■ = if node j cannot be reached from the m'th uppermost 
SCC along directed links in the original network. 
By substituting Eq. (lT2"j) in Eq. OH]), we obtain 



Vi 



T N u (0) 
; N 



for node i that belongs to the m'th uppermost SCC. For these nodes, Vi > is satisfied. For 
nodes that do not belong to an uppermost SCC, we obtain Vi = 0. Equation (JTTj) guarantees 
that Yli=i v i = 1- Equation f JT8|) generalizes the definition for strongly connected networks 
given by Eq. ([1]). We interpret the right-hand side of Eq. (I18p to be the multiplication of the 
influence of node i within the m'th SCC (i.e., u m ',i) an d the relative influence of the m'th SCC 
in the entire network (i.e., YljLi u m>,j/N)- 

For pedagogical purposes, the calculations of u$ for two toy networks with N = 4 and m = 2 
are presented in the Appendix. 



IV. INTERPRETATION OF INFLUENCE FOR NETWORKS WITH MULTIPLE 
ROOT NODES 

Borm and colleagues defined the Laplacian centrality measure on the basis of the continuous- 
time simple random walk on networks. In this section, we further motivate this definition by 
showing that given by Eq. fl 181) have other interpretations, as is the case for V{ formulated 
for strongly connected networks 13j. 
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A. Collective responses in the DeGroot model of consensus formation 



The DeGroot model represents dynamical opinion formation in a population of interacting 



individuals 



231 ] . The dynamics of the continuous-time version of the DeGroot model 



known as Abelson's model 



24|, also 



181 ] . are defined by 



x(t) = -Lx(t), 



(19) 



where x(t) = [x\(t) ■■■ XN(t)] T G R N represents the time- dependent opinion vector. For 
networks with m — 1, including strongly connected networks, the consensus, i.e., synchrony, 
is asymptotically reached. In this case, the final synchronized opinion is given by vx(0). 
Therefore, Vi is equal to the fraction of the initial opinion at node i reflected in the final opinion 



of the entire network [13l 



25. 



When m > 2, synchrony is neutrally but not asymptotically stable. Therefore, the consensus 
of the entire network is not generally reached from a general initial condition. The final opinion 
vector is given by 

Jim x(t) = Jim e- Lt x(0) = ( ^ z 



t— S-OO 



t— >oo 



\m'=l 



If we set Xj(0) = 5ij (1 < j < N) to introduce a different opinion of unit strength at node 
i to the initial all-0 consensus state, the average response of the nodes induced by a different 
opinion at node i is equal to 

i im _L y^ Xj (t) = — (i ... i) y 



3=1 



l m' V m' 



(21) 



m'=l 



where is the A-dimensional unit column vector such that the ith element is equal to 1 and 
the other elements are equal to 0. Because Eq. (|2~T|) coincides with Eq. fTTSl) . the amount of the 
initial opinion of node i reflected in the final opinion of the entire network is given by Eq. (ITS]) . 



B. Stationary density of voter model 

The so-called link dynamics is a stochastic interacting particle system on networks in which 



each node takes one of the two opinions A and B [26(. In each time step, one link is randomly 
selected from the network with a probability proportional to the weight of the link. Then, the 
state of the source node of the link replaces that of the target node of the link if their states 



9 



are different. Note that opinions A and B are equally strong in the dynamics. The dynamics 
halt when A or B takes over the entire network. The fixation probability of node i is defined as 
the probability that B takes over the network when the initial configuration is such that node i 



takes B and t 
of node i 13 



re other N — 1 nodes take A. When m = 1, Vi is equal to the fixation probability 



20]. 



When m > 2, the fixation of B introduced at node % never occurs. If node % is located in a 
downstream SCC, B eventually vanishes because A in the uppermost SCCs is permanent and 
replaces B in the downstream SCCs. If node % is located in an uppermost SCC, this SCC ends 
up with being entirely occupied by B with a positive probability. However, other uppermost 
SCCs are permanently occupied by A, such that the consensus is never reached. 

In this situation, consider the expected fraction of B in the network in the stationary state 
when we start from the initial configuration with a single B at node i. The probability that 
B takes over the m'th uppermost SCC to which node % belongs is equal to v m /^. Under the 
condition that the m'th uppermost SCC is entirely occupied by B and the other m—1 uppermost 
SCCs are entirely occupied by A, the master equation for the probability pj D that node j in a 
downstream SCC is occupied by B is given by 

^ =d - vT) £ - pT £ »«d - vf), 

j'=i j'=i 

N N 

Z'O',/'!' 1 /'!- n »<.r (22) 
j'=i j'=i 

where we set p^P = 1 when node j' belongs to the m'th uppermost SCC and p^P = when 
node j' belongs to one of the other uppermost SCCs. 

Equation ([22]) implies that in the equilibrium, (p\ D ■ ■ ■ p^P) T is a right zero eigenvector of 
L and identical to w^, given by Eq. ( TT3"j) . Therefore, the stationary fraction of opinion B in 
the network is given by Eq. (ITS]) . 



C. Enumeration of spanning trees 



When m — 1, the matrix-tree theorem implies that Vi is proportional to the sum of the 
weights of all the possible directed spanning trees rooted at node i {9, 10, l^j]. The weight of a 
spanning tree is defined as the multiplication of all the weights of the N — 1 links included in 
the spanning tree. 
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The Markov chain tree theorem extends this result to the case m > 2 [27(. According 
to this theorem, u m / i( ii^; . for general directed networks is proportional to the sum of the 
weights of all the arborescences such that node i is a root node of the arborescence and the 
arborescence passes node j. An arborescence is a subgraph of the original networks with N 
nodes such that the indegree of each node restricted to the arborescence is at most one, it 
has no cycles, and it contains the maximal number of links. The nodes whose indegrees are 
zero within the arborescence are called the root nodes of the arborescence. They form G r such 
that the concept of the root node for the arborescence and that for the network Laplacian 10] 
are identical. Therefore, the number of links in an arborescence is equal to N — m, and the 
arborescence is composed of m disconnected directed trees each of which emanates from a root 
node. Intuitively, v m iju®, ■ represents the number of different ways in which node i influences 
node j. 

The influence of node i defined by Eq. ( Il8p is proportional to the summation of all the 
arborescences with the modified weight. The modified weight of an arborescence is defined by 
the multiplication of all the weights of the N — m links included in the arborescence and the 
number of nodes included in the directed tree rooted at node % in the arborescence. If node % 
is not the root of the arborescence, we set the weight of this arborescence to zero. 



V. INFLUENCE OF NODES IN DOWNSTREAM COMPONENTS 



A. Definition of the extended influence 



With the definition given by Eq. ( TT8j) . nodes that do not belong to any uppermost SCC 
have Vi = 0. In practice, however, we often need to assess the relative importance of different 
nodes in downstream SCCs and that of nodes in different downstream SCCs. There also arise 
occasions when we want to compare uninfluential nodes in an uppermost SCC and influential 
nodes in a downstream SCC. 

An extreme situation in which this is the case is realized by the network shown in Fig. |^a). 
Whenever e > and a > 0, we obtain v i = v 2 = and v 3 = l. However, when e and a are 
small, node l may be regarded to be more central than node 3 because node l is much more 
central than node 2 and node 3 only weakly influences noncentral node 2. To cope with such a 
situation, we extend the influence to a one-parameter family of centrality measure by adopting 



ll 



the concept behind the definition of the PageRank. 

The PageRank of node i, denoted by Ri, is defined as the stationary density of the discrete- 
time simple random walk as follows 



N 

Ri = (1 - g) ™ ji R, + ^ Efi WU>0 (1 -q)Ri + ±, (l<i<N), (23) 

i=i l^e=i w j£ 



where 8ij = 1 if i = j and 8ij = if i ^ j. The so-called teleportation probability q represents 
the probability that the random walker jumps from any node to an arbitrary node in one step. 
The same concept underlies the definition of the centrality based on the adjacency matrix 0,0]. 
According to the second term on the right-hand side in Eq. (I2"3"j) . the random walker stays at 
the node without outgoing links with probability 1 — q. The introduction of q is necessary for 
treating networks that are not strongly connected. 

The PageRank is originally designed for web graphs. Therefore, receiving links increases Ri, 
which is opposite to the contention of the influence. To relate the PageRank to the influence, 
we consider the PageRank in the network generated by reversing all the links of the original 



network 



131 ] . We denote this quantity for node i by i?J cv , which is determined by 



N 



RT = (i - 9) E *T + ^,o(i - <i)RT + (i<i<N). (24) 

j=l 1^,1=1 W f-j 

As explained in Sec. IHfl the influence corresponds to the continuous-time random walk 
on the link-reversed network. In a strongly connected network, the influence of each node 



is equal to t 



network 
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re stationary density of the continuous-time random walk on the link-reversed 



20] . As in the definition of the PageRank, let us introduce random global jumps 



to the continuous-time random walk on the link-reversed network. We do so by assuming that 
the walker jumps from any node to an arbitrary node with rate q. Note that q represents a 
probability in the PageRank, whereas it is a rate in the influence. In the following, we allow q 
to exceed unity unless otherwise stated. The destination of the random jump is chosen from all 
the nodes with equal probability 1/N. We denote by Vi the stationary density of the modified 
random walk at node i. The normalization is given by YliLi^i = 1- The stationary density is 
obtained from 

dv N N 
We define the extended influence by the solution of Eq. (1251) . We note that the link- reversed 



12 



version of Eq. (1231) . with a different structure of the global jump, was proposed as an alternative 



of the PageRank to be applied to web graphs 



2n 



In the vector notation, Eq. (125]) is represented by 

N 



... v N )(L + qI) = ^(l .-. 1), (26) 



or equivalently, 



(«!•-. f) iV )(L + g/-^J) = 0, (27) 



where J is the N by iV matrix whose all the elements are equal to unity. If q > 0, L + g/ is 
strictly diagonally dominant, and Eq. (|26|) can be solved by the Jacobi or Gauss-Seidel iteration. 



16] . 



A large q guarantees exponentially fast convergence of the iteration 
We note that 

m 

L + ql = £ qv<$v® + (A 2 + g)^ 2 ^ + . . . , (28) 

m' = l 

which leads to 

(i + „/)-' = ± + r i ^ u ^ ) "! Al) + • • • ■ < 29 > 

In the limit g — > 0, Eq. ( 12 9 j) implies that t)j ~ Uj, where is defined by Eq. (jSJ). For the first 
term on the right-hand side of Eq. (jSJ) to be comparable with the remaining terms, q must be 
at least approximately ReA 2 . If this is the case, can quantitatively differentiate various nodes 
including those in downstream components. 

In the limit q — > oo, Eq. ( 126]) gives £>j = 1/N (1 < i < N). When q is a large finite value, 
Eq. (1261) is expanded as 

(*•••«») 4 (1 - 1 'B- 1 ''(i " 

=^(i • ■ • i) + ^(^r - ^ • ■ ■ ^ ut - + o (^) , (so) 

where k° nt and fc™ are the outdegree and the indegree of node i, respectively. The Taylor 
expansion is justified when q > ReA^, where A^ is the eigenvalue of L with the largest modulus. 
If q is large relative to ReA^, the influence is determined by the outdegree and the indegree 
and is independent of the global structure of networks. Therefore, in practice, q should not be 
too large as compared to ReA^. This is surprising because a large q implies a strong global 
connectivity. As a rule of thumb, we recommend setting ReA 2 < q < ReA^. A suitable range of 
the teleportation probability q for the PageRank can be also obtained by applying the criterion 
ReA 2 < q < ReA^v to the PageRank matrix implied in Eq. 
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B. Interpreting the extended influence without regard to global jumps 



We have extended the influence by introducing global jumps to the continuous-time random 
walk on the link-reversed network. However, the meaning of the teleportation term in terms 
of the dynamical and structural properties of the nodes in the network and its rationale are 
somewhat vague. We show that the extended influence defined by Eq. (|26|) allows another 
interpretation: absorption probability of the random walk on the link-reversed network with a 
sink attached to each node but without global jumps. A similar interpretation was made for 



the PageRank in Ref. 29]. 



We assume N additional source nodes indexed by 1', . . ., N' and directed links with weight 
q > from node %' to node % (1 < i < N) in the original network. The extension of the network 
shown in Fig. |3]^a) is depicted in Fig. [3]^b). The extended network has 2N nodes. Nodes 1', . . ., 
N' are the unique root nodes of the extended network. Node %' forms the ith uppermost SCC 
in the extended network. The multiplicity of the zero Laplacian eigenvalue of the extended 
network is equal to m — N. 

We then reverse all the links and consider the probability that the random walker starting 

from an arbitrary node with equal probability 1/2N is absorbed at node %' . This probability 

is given by Vy. Because it is obvious and uninformative that the random walker starting from 

the auxiliary node i' is necessarily absorbed to node i', we would like to exclude this factor. 

Therefore, we examine the quantity given by 

1 \ 1 

Vy = 2vy . (31) 

2NJ N K J 

The subtraction of 1/ (2N) in Eq. ([31]) accounts for the exclusion of the random walker starting 

from and absorbed to node il . The multiplicative factor 2 accounts for the fact that we effectively 

start the random walk from nodes 1, . . ., N with equal probability 1/N. 

Equation (I18p implies that the calculation of vy involves i^i, that is, the first element of the 

left zero eigenvector of L corresponding to the ith uppermost SCC. Because the uppermost SCC 

consists of single node i', v^x is equal to unity. The calculation of Vy also involves uf = (e, Tii) T , 

that is, the zero eigenvector of the 2iV-dimensional Laplacian. uj is an iV-dimensional column 

vector. By substituting these expressions and Eq. ffl8|) in Eq. fl3Tl) . the quantity given by 

Eq. ( 13Tj) is equal to 

y 1 ' 1 2N 2NJ N 1 ; 
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We calculate uj from 

O O 



)l 


'e,\ 




I Ui / 



0, (33) 



-ql L + ql 

where O is the N x N zero matrix and L is the Laplacian of the original network. Equation (133]) 
is equivalent to 

(L + qI)Ui = qe { . (34) 

By combining Eqs. (132]) and ( 134|) . we obtain Eq. ([26]) • 

With this interpretation, we gain an intuitive understanding of the fact that the extended 
influence Vi is a local quantity when q is large. In this situation, the tendency that a random 
walk exits from each node is strong, and a random walk would not travel a long distance before 
being absorbed. Therefore, it is natural that at large q is efficiently approximated by local 
quantities of nodes such as the outdegree and the indegree, as discussed using Eq. (13T)]) . 

VI. TOY EXAMPLES 

In this and the next section, we apply the extended influence to various networks. 

A. Network with N = 3 

Consider the network shown in Fig. HHa). We are concerned with the situation in which 
< e <C 1 such that node 1 is apparently much more central than node 2. If node 3 is absent, 
V1/V2 = 1/e; node 1 is actually much more influential than node 2 Q|- However, regardless 
of the value of a > 0, node 3 takes all the share of the influence if we use V\. 

The extended influence (1 < % < 3) is equal to Vi for the network shown in Fig. E^b). We 
obtain 

v l =^ K [q 2 + (2 + a)q], (35) 
h ~ (q 2 + 2eq) , (36) 
h =3^ [q 2 + (1 + e + 2a) q + 3ea] , (37) 

where 

A = q 2 + (1 + e + a)q + ea. (38) 



15 



Therefore, Vi > £3 when (1 — e — a)q > 3ea. When e or a is small and e + a < 1, we have an 
intuitive result that node 1 is more influential than node 3. 



B. Directed chain 

Consider a directed chain having N nodes defined by Wa + i — l(l<i<N — 1) and 



= C/ ^ i + 1). 



he network is schematically shown in Fig. |2j We obtain t>i = 1 and 



Vi = (2 < i < N) [l4]. However, nodes with small i are located relatively upstream in the 
chain and intuitively appear influential as compared to nodes with large %. We can calculate 
the influence either by solving Eq. fl34|) or by analyzing random walks with iV traps on the 
network obtained by reversing all the links shown in Fig. |2J When the random walker on the 
link-reversed network starts from node j (2 < j < N), the probability that the walker exits 
from node i to the absorbing node i' is equal to 



(0) 



(< = 1), 

(2<i<j), (39) 



1 

q 

0, (j + 1 < % < N). 



Therefore, we obtain 



^E4° , = H' : *~ ,<1+ ' > ^' { ' '" ' 40 > 



We note that limq^o^i — 1, h m g-s-o Vi = (2 < % < N), and Vi monotonically decreases with i 
for any q > 0. 

VII. NUMERICAL RESULTS 

In this section, we examine the influence in three directed networks: a random graph, a 
neural network, and an online social network. 

A. Descriptions of networks 

We generate a directed random network with N = 100 and expected degree (k) = 3.5 by 
connecting each ordered pair of nodes independently with probability (k) /(N — 1). Because 
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(k) is relatively small, the generated network is not strongly connected, whereas it is weakly 
connected, i.e., not divided into disconnected components. The generated network has three 
root nodes, each of which forms an SCC. The largest SCC contains 94 nodes and is downstream 
to the three root nodes. The extremal Laplacian eigenvalues are A2 = 0.046 and Xn = 8.255. 



We generate a C. elegans neural network with N = 279 on the basis of published data 30]. 
In this network, there exist two types of links: undirected gap junctions and directed chemical 
synapses. A pair of neurons can be connected by multiple synapses. We regard this network as 
a weighted directed network, where the weight of the link from neuron % to neuron j is defined 
as the summation of the number of gap junctions between % and j and the number of chemical 
synapses from i to j. The network has 2993 links. The largest SCC has 274 nodes [l3|. Four of 
the five remaining nodes are located upstream to the largest SCC and form individual SCCs. 
The other node is located downstream to the largest SCC. The extremal Laplacian eigenvalues 
are A 2 = 0.050 and \ N = 354.105. 

The third network that we use is an online social network among students at University of 



California, Irvine 



311 ] . This network has N = 1899 nodes and 20296 directed and weighted 



links. We focus on the largest weakly connected component of this network that contains 
1893 nodes and 13835 links. There exist 103 root nodes, each of which forms an SCC. The 
largest SCC has 1023 nodes and is downstream to these root nodes. The extremal Laplacian 
eigenvalues are A 2 = 0.146 and Xn = 92.996. 



B. Analysis of influence in the three networks 

The rank plots of the influence for various values of q for the random graph, neural network, 
and online social network are shown in Figs. Hfa)-(c), respectively. In the figure, the values of 
Vi are shown in the ascending order for each q for clarity. 

When q = 0.001 (thickest lines), x5» is similar to V\ for the three networks. Therefore, the 
root nodes have exclusively large £>j, whereas the other nodes have £>j ~ 0. Accordingly, we 
find a sudden jump in the rank plot for each network. Such a small value of q does not 
allow us to quantitatively compare the centrality of nodes in downstream components. This is 
also anticipated from the fact that the three networks yield q = 0.001 < ReA2- In the other 
extreme, Vi ~ 1/N is roughly satisfied when q = 1000 (thinnest lines). This is consistent with 
the fact that the three networks yield q = 1000 > ReAyv. In this range of q, the influence is 
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not an adequate centrality measure. For intermediate values of q, Vi is reasonably dispersed, 
and nodes that are not the roots are also endowed with positive We consider that the 
influence with intermediate values of q enables us to compare the importance of nodes that are 
in downstream SCCs and quantify the relative importance of nodes in uppermost SCCs and 
nodes in downstream SCCs. 

The influence with intermediate values of q is distinct from the interpolation of the influence 
when q — y (i.e., V{ ~ u$) and that when q = oo (i.e., u$ = 1/N). The order of the nodes in 
terms of the value of drastically changes as q varies. To demonstrate this, we examine the 
dependence of Vi on q for some selected nodes. 

For the random graph, we select the three root nodes, for which V{ is the largest at q — 0.001 
and the three nodes whose V{ is the largest at q = 10. The dependence of x>\ on q for the six 
nodes is shown in Fig. 0(a). The three root nodes [solid lines in Fig. |5fa)] and the three nodes 
with the largest at q = 10 (dashed lines) do not overlap each other. In particular, the root 
node with the third largest V{ for q = 0.001 does not have large Vi when q is approximately 
larger than 1. Although the indegree of this root node is equal to zero, the destinations of the 
links from this root node are presumably nodes with small influence values in the largest SCC. 
This phenomenon is essentially the same as that shown in Fig. |3j 

The neural network has four root nodes. The dependence of i)i on q for the root nodes and 
the three nodes whose di is among the four largest values at q = 10 are shown in Fig. E(b). 
In the neural network, one of the four roots is among the nodes with the four largest values 
of Vi at q = 10. For the online social network, the relationships between £>j and q for the five 
root nodes with the largest Sj at q — 0.001 and the five nodes with the largest Vi at q = 1000 
are shown in Fig. 0(c). The results for the neural network and the online social network are 
qualitatively the same as those for the random graph. In particular, some root nodes (solid 
lines) do not have particularly large di when q is approximately larger than unity. 

Finally, we quantify the dependence of the influence on q by calculating the Kendall rank 
correlation coefficient. It is defined as 2{P/[N(N — l)/2] — 1}, where P is the number of pairs 
2, j (1 < 2 < J < N) such that the sign of V\ — Vj for q = q± is the same as that for q = q2- 
The correlation coefficient falls between —1 and 1. The correlation coefficient for the random 
graph for various values of q is shown in Fig. [^a). As anticipated, the correlation decreases 
with \qi — q 2 \. Figure 0(a) also indicates that the ranking on the basis of the influence is fairly 
insensitive to q in two ranges of q, i.e., for q smaller than « 1 and for q larger than « 10. 
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The ranking is sensitive to q between these two ranges of q. For comparison, the correlation 
coefficient for the PageRank for various values of q is shown in Fig. &b). Similar to the case 
of the influence, the correlation decreases with \qi —qz]. The correlation between the influence 
and the PageRank [Fig. EJ^c)] is generally small regardless of the two values of q. On this basis, 
we claim that the influence and the PageRank are distinct centrality measures. This result 
generalizes that when directed networks are strongly connected and q = 13 ) . 

The rank correlation coefficient for the neural network and the social network calculated in 
the same manner is shown in Figs. E(d)-(f) and Figs. EHg)-(i), respectively. The results are 
qualitatively the same as those for the random graph (Figs. [B^a)-(c)). 



VIII. CONCLUSIONS 



We have proposed a centrality measure (influence) for general directed networks. It is a 
generalization of a Laplacian-based centrality measure that is often used for strongly connected 



networks 



7-9 



13 



-Il5l]. It also generalizes the formulation of the same centrality measure de- 



veloped for networks that are not necessarily strongly connected 1 OM 1 21] . Unlike the previous 



measure 



10 



J-il2j|. the proposed measure is suitable for comparing the importance of nodes that 
are in downstream SCCs and comparing nodes in different SCCs. It has a free parameter q. 
For networks that are not strongly connected, we suggest using ReA2 < q < ReA^v (Sec. IV Aj) . 
A small value of q implies that the centrality values concentrate on nodes in uppermost compo- 
nents. A large value of q makes the influence close to a degree centrality, i.e., outdegree minus 
indegree. The choice of q is up to users' preferences. We acknowledge that various mathemat- 
properties of the matrix associated with the influence (i.e., L + ql) have been analyzed in 



ica 



10 



ll| . In ll| , the use of this matrix for the centrality measure is briefly mentioned. 



Arguably, the most frequently used centrality measure for directed networks appears to 
be the PageRank 6|. Beyond the World Wide Web, for which the PageRank was originally 
designed, the PageRank has been applied to rank, for example, academic papers and journals 
(e.g., 32|). The PageRank is interpreted as the stationary density of the discrete-time simple 



random walk with global jumps on the network. 

We have defined the influence as a continuous-time counterpart of the PageRank. Further- 
more, we have provided the interpretation of the influence as the absorption probability of the 
continuous-time random walk to the sink attached to each node but not with global random 
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jumps. As a corollary, the PageRank can be interpreted as the absorption probability of the 
random walk without teleportation to a sink. In addition, a suitable range of the teleportation 
probability in the PageRank can be estimated by adapting the criterion ReA2 < q < ReA^ to 
the discrete-time random walk. 

For the case of strongly connected networks, we refer to our previous work 



13 



20| for a 



discussion of continuous-time versus discrete-time random walk. We have shown that q controls 
the relative importance of nodes in upstream SCCs and nodes in downstream SCCs. The same 
role is shared by the teleportation probability in the PageRank. Then, why do we feel the need 
to introduce a new centrality? 

First, the extended influence inherits the definition of the influence for strongly connected 
networks and one-root networks (i.e., influence when q = 0), and therefore, it represents the 
importance of nodes in various dynamics and in the enumeration of spanning trees (Sec. II Vp . 
Actually, for each dynamics considered in Sec. IIVI we can consider a discrete-time version and 
relate the importance of nodes in the dynamics to the PageRank. We have explained this 
correspondence for the random walk (Sec. |V]). In addition, the DeGroot model of opinion 
formation was originally proposed in discrete time 23j. We should choose one among the two 
centrality measures depending on whether the continuous-time or discrete-time dynamics are 
assumed to occur on the network in question. 

In the discrete-time interpretation, the indegree is essentially normalized to be unity. There- 
fore, if the weight of the link represents a value that should not be normalized, such as the 
rate of interaction, nominal connection strength, amount of signal or monetary fluxes, and the 
number of wins and losses between a pair of sports teams, the continuous-time interpretation, 
that is, the influence, appears to be more appropriate. On the other hand, the PageRank is 
more appropriate in the case of scientometry; if a paper cites many papers, the value of each 
citation should be considered to be small, and being cited from this paper should not be of 
great importance. This distinction may underlie the current situation that the PageRank and 
the Laplacian-based centrality have been used in somewhat different research communities and 
for different types of data. In this light, we have extended the Laplacian-based centrality so 
that it is applicable to general directed networks, as is the PageRank. 

Second, the PageRank has a subtle arbitrariness in determining the behavior of the random 
walk that has reached a dangling node. Depending on the implementation, the walker at a 
dangling node hops to a randomly chosen node even with probability 1 — q (0 < q < 1) js] 
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or stays at the same node with probability 1 — q [33J. The theoretical justification for either 
assumption is not clear. In the influence, we have the sole control parameter q, and the influence 
unambiguously corresponds to the discrete-time case in which the walker stays at the dangling 
node with probability 1 — q. 
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Appendix: Influence for two toy networks with multiple root nodes 



For the network with four nodes and two root nodes shown in Fig. [TJ^a), we obtain m = 2 
6 = 3,^ = 1,^2 = 2,^3 = 1, 

/ o o o\ 

1-10 
0-110 
\ -1 -1 2/ 



(41) 



v{ 0) = (1 0), u 



v 



(0) 



1 1 

- - 

2 2 



Therefore, the influence is given by 



(0) 



u 



(0) 



_5_ 
16 



/l\ 




\iJ 

/o\ 

1 
1 

U7 



, v 4 = 0. 



(42) 



(43) 



(44) 
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Nodes 2 and 3 have the same influence because they are as strong as each other within their 
SCC. Although the two upstream SCCs are upstream to node 4 in the same manner, v\ is 
smaller than v 2 + v% because V\ controls two nodes and the SCC of nodes 2 and 3 controls three 
nodes. 

For the network with four nodes and two root nodes shown in Fig. [3(b), we obtain m = 2, 
b = 3, N, = 1, N 2 = 1, N 3 = 2, 

/ \ 

-1 1 + e -e 
\ -1 -1 2 / 



(45) 



The influence is given by 



v 



(0) 



(1 0), u\ 



(o) 



4 0) = (0 10 0), u 



(o) 

2 



Vl 



5 + e 



3(1 



/ 1 \ 



2 
2+e 

( o \ 
1 

e 

2+e 



V2 



V 3 



v A = 0. 



(46) 



(47) 



(4* 



4(2 + e)' ^ 4(2 + e) 

Vi > i>2 because node 1 is connected to the more influential node of the downstream SCC (i.e., 
V3) unlike node 2, which links to the less influential node of the downstream SCC (i.e., V4). 
Note that when e ~ 0, the effect of node 1 on node 4 is similar to that of node 2 on node 4, 
despite the fact that node 1 does not directly link to node 4, whereas node 2 does. The reverse 
is not the case; when e ~ 0, node 1 can affect node 3, but node 2 can hardly do so. 



[1] R. Albert and A.-L. Barabasi, Rev. Mod. Phys. 74, 47 (2002). 

[2] S. Boccaletti, V. Latora, Y. Moreno, M. Chavez, and D.-U. Hwang, Phys. Rep. 424, 175 (2006). 

22 



[3] M. E. J. Newman, Networks — An introduction (Oxford University Press, Oxford, 2010). 
[4] L. Katz, Psychometrika 18, 39 (1953). 

[5] S. Wasserman and K. Faust, Social Network Analysis (Cambridge University Press, New York, 

1994); Network Analysis, edited by U. Brandes and T. Erlebach (Springer, Berlin, 2005). 
[6] S. Brin and L. Page, Proceedings of the Seventh International World Wide Web Conference pp. 

107-117 (Elsevier, Amsterdam, 1998); A. N. Langville and C. D. Meyer, Google's PageRank and 

Beyond (Princeton University Press, Princeton, 2006). 
[7] H. E. Daniels, Biometrika 56, 295 (1969); K. A. Berman, SIAM J. Algebraic Disccrete Methods 

1, 359 (1980). 

[8] J. W. Moon and N. J. Pullman, SIAM Rev. 12, 384 (1970). 
[9] N. Biggs, Bull. London Math. Soc. 29, 641 (1997). 
[10] R. P. Agaev and P. Y. Chebotarev, Autom. Remote Control (Engl. Transl.) 61, 1424 (2000). 



[11] P. Chebotarev and R. Agaev, e-print arXiv:math/0508171 



[12] N. E. Bonn, R. Van Den Brink, and M. Slikker, Ann. Operat. Res. 109, 61 (2002). 
[13] N. Masuda, Y. Kawamura, and H. Kori, New J. Phys. 11, 113002 (2009). 
[14] N. Masuda, Y. Kawamura, and H. Kori, Phys. Rev. E 80, 046114 (2009). 
[15] K. Klemm, M. A. Serrano, V. M. Egmluz, and M. San Miguel, arXiv:1002.4042v2 
[16] G. H. Golub and C. F. V. Loan, Matrix Computations, 3rd ed. (Johns Hopkins University Press, 
Baltimore, 1996). 

[17] R. A. Horn and C. R. Johnson, Matrix Analysis (Cambridge University Press, Cambridge, Eng- 
land, 1985). 

[18] R. P. Abramson, in Contributions to Mathematical Psychology, edited by N. Frederiksen and H. 

Gulliksen, (Holt, Rinehart and Winston, New York, 1964), pp. 141-160. 
[19] G. B. Ermentrout, SIAM J. Appl. Math. 52, 1665 (1992). 
[20] N. Masuda and H. Ohtsuki, New J. Phys. 11, 033012 (2009). 

[21] R. B. Bapat and T. E. S. Raghavan, Nonnegative Matrices and Applications (Cambridge Univer- 
sity Press, Cambridge, England, 1997). 

[22] A. Berman and R. J. Plemmons, Nonnegative Matrices in the Mathematical Sciences (Academic 
Press, San Diego, CA, 1979). 

[23] M. H. DeGroot, J. Am. Stat. Assoc. 69, 118 (1974); N. E. Friedkin, Am. J. Sociol. 96, 1478 
(1991). 

23 



[24] R. Olfati-Saber, J. Fax, and R. Murray, Proc. IEEE 95, 215 (2007). 

[25] H. Kori, Y. Kawamura, H. Nakao, K. Arai, and Y. Kuramoto, Phys. Rev. E 80, 036207 (2009). 
[26] T. Antal, S. Redner, and V. Sood, Phys. Rev. Lett. 96, 188104 (2006); V. Sood, T. Antal, and 

S. Redner, Phys. Rev. E 77, 041121 (2008). 
[27] F. T. Leighton and R. L. Rivest, IEEE Trans. Inf. Theory 32, 733 (1986). 

[28] Y. Liu, B. Gao, T. Y. Liu, Y. Zhang, Z. Ma, S. He, and H. Li, SIGIR08: Proceedings of the 
31st Annual International ACM SIGIR Conference on Research and Development in Information 
Retrieval (ACM, New York, 2008) pp. 451-458; Y. Liu, T. Y. Liu, B. Gao, Z. Ma, and H. Li, Inf. 
Retrieval 13, 22 (2010). 

[29] K. Avrachenkov, N. Litvak, D. Nemirovsky, and N. Osipova, SIAM J. Numer. Anal. 45, 890 
(2007). 

[30] B. L. Chen, D. H. Hall, and D. B. Chklovskii, Proc. Natl. Acad. Sci. U.S.A. 103, 4723 (2006); 

http: / / www.wormatlas.org 
[31] P. Panzarasa, T. Opsahl, and K. M. Carley, J. Am. Soc. Inf. Sci. Technol. 60, 911 (2009). 
[32] I. Palacios-Huerta and O. Volij, Econometrica 72, 963 (2004); A. Fersht, Proc. Natl. Acad. Sci. 

U.S.A. 106, 6883 (2009). 

[33] S. Fortunato, A. Flammini, F. Menczer, and A. Vespignani, Proc. Natl. Acad. Sci. U.S.A. 103, 
12684 (2006). 



24 



FIG. 1: A network with two root nodes. 
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FIG. 2: Directed chain with N nodes. 
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(a) , (b) , 



4 4 



FIG. 3: (a) Example of directed network with N = 3. (b) Network with 2N = 6 nodes obtained by 
adding source nodes to the network shown in (a). 
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i 

FIG. 4: Values of V{ for (a) random graph, (b) neural network, and (c) online social network. We set 
q = 0.001, 0.1, 1, 10, 1000 (from steep thick lines to flat thin lines). For each q, we have sorted v% in 
the ascending order for demonstration. 
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FIG. 5: Dependence of Vi of some nodes on q for (a) random graph, (b) neural network, and (c) online 
social network. The nodes with the largest influence values for q = 0.001 and for q = 10 correspond 
to the solid and dashed lines, respectively. 
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FIG. 6: Kendall rank correlation coefficient for the influence and the PageRank. (a)-(c) Random 
graph, (d)-(f) neural network, and (g)-(i) online social network, (a, d, g) Correlation between the 
influence for different values of q. (b, e, h) Correlation between the PageRank for different values of 
q. (c, f, i) Correlation between the influence and the PageRank for various values of q. 
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